A review of asymptotic convergence forgeneral state space
نویسنده
چکیده
We review notions of small sets,-irreducibility, etc., and present a simple proof of asymptotic convergence of general state space Markov chains to their stationary distributions.
منابع مشابه
A review of asymptotic convergence for general state space Markov chains
We review notions of small sets, φ-irreducibility, etc., and present a simple proof of asymptotic convergence of general state space Markov chains to their stationary distributions.
متن کاملGENERALIZED FUZZY VALUED $theta$-Choquet INTEGRALS AND THEIR DOUBLE-NULL ASYMPTOTIC ADDITIVITY
The generalized fuzzy valued $theta$-Choquet integrals will beestablished for the given $mu$-integrable fuzzy valued functionson a general fuzzy measure space, and the convergence theorems ofthis kind of fuzzy valued integral are being discussed.Furthermore, the whole of integrals is regarded as a fuzzy valuedset function on measurable space, the double-null asymptoticadditivity and pseudo-doub...
متن کاملStrong convergence of modified iterative algorithm for family of asymptotically nonexpansive mappings
In this paper we introduce new modified implicit and explicit algorithms and prove strong convergence of the two algorithms to a common fixed point of a family of uniformly asymptotically regular asymptotically nonexpansive mappings in a real reflexive Banach space with a uniformly G$hat{a}$teaux differentiable norm. Our result is applicable in $L_{p}(ell_{p})$ spaces, $1 < p
متن کاملAsymptotic properties of constrained Markov Decision Processes
We present in this paper several asymptotic properties of constrained Markov Decision Processes (MDPs) with a countable state space. We treat both the discounted and the expected average cost, with unbounded cost. We are interested in (1) the convergence of nite horizon MDPs to the innnite horizon MDP, (2) convergence of MDPs with a truncated state space to the problem with innnite state space,...
متن کاملAsymptotic behavior of a system of two difference equations of exponential form
In this paper, we study the boundedness and persistence of the solutions, the global stability of the unique positive equilibrium point and the rate of convergence of a solution that converges to the equilibrium $E=(bar{x}, bar{y})$ of the system of two difference equations of exponential form: begin{equation*} x_{n+1}=dfrac{a+e^{-(bx_n+cy_n)}}{d+bx_n+cy_n}, y_{n+1}=dfrac{a+e^{-(by_n+cx_n)}}{d+...
متن کامل